How I think about large language models

AI
How I expect to be using AI Large Language Models in the future.
Published

March 28, 2023

The biggest problem I have with today’s LLMs is their trustworthiness. It’s one thing to give it a toy problem, as Ethan Mollick and other educators do, but the real world is different from what you’ll encounter at school.

School is a variation on what Nassim Taleb calls the “ludic fallacy”, the idea that a solution to a toy problem has validity outside the constraints that allowed the toy solution. You can model casino games with all the fancy statistics you like, but in the real world there will always be something outside your model. What if your apparently normal deck of cards is in fact tainted? What if the casino goes bust before you collect your earnings?

It’s one thing to have ChatGPT write a fluent essay about some topic of which I have some familiarity: I can quickly spot and correct any errors or “hallucinations”. In other words, ChatGPT is a good substitute for an intern, whose often ill-formed ideas need massaging or correction by somebody with more experience. The dangers happen when you don’t have somebody who can easily supervise the output.

LLMs for computer programming can be a big help precisely because they’re easy to test. Run the code and see if it works! You can even have the LLM write its own test code and prove that.

LLMs can also be useful when learning something new, especially something you can’t get from a Wikipedia or book search. Asking for comparisons across disparate genres, for example, can be a good way to spark ideas for further investigation.

This exchange demonstrates one way this is useful

Christianity is pretty clear that all people are created equal “in the image of God” and that it’s a moral obligation to treat everyone with dignity. Does Chinese philosophy have the same underlying belief?

Yes, many Chinese philosophical traditions hold that all people are equal and should be treated with dignity. For example, Confucianism, one of the main philosophical traditions in China, emphasizes the importance of treating others with respect and fairness. In the Analects, Confucius says, “All men are equal before heaven.” This idea is echoed in the concept of ren, which emphasizes the importance of treating others with kindness and compassion. Similarly, the concept of xiao, or filial piety, emphasizes the importance of showing respect and devotion to one’s parents and elders. Overall, many Chinese philosophical traditions place a strong emphasis on treating others with kindness and respect.

Of course Confucianism emphasizes respect. But it’s blatantly obvious that people are different, and that some people have more talent and abilities than others. In Christianity, however, the equality is made very explicit, from the most powerful and even most saintly, “we are all sinners” in need of redemption. Can you describe ways in which the Chinese view of equality is fundamentally different?

While Confucianism does place an emphasis on treating others with respect and kindness, it does not necessarily hold that all people are equal in the same way that Christianity does. Confucianism is primarily concerned with the relationships between people and the obligations that arise from those relationships. As a result, Confucianism recognizes that people have different roles and responsibilities in society, and that these roles and responsibilities can affect the way that people are treated. For example, a parent is expected to show love and devotion to their children, while children are expected to show respect and obedience to their parents.

Yes, and does Confucianism think poor people have the same dignity and importance as kings or nobles?

In Confucianism, everyone is seen as having inherent worth and dignity, regardless of their social status or position in society. While Confucianism does recognize the importance of social hierarchy and the need for people to fulfill their proper roles in society, it also emphasizes the importance of treating everyone with kindness and respect. In the Analects, Confucius says, “He who exercises government by means of his virtue may be compared to the north polar star, which keeps its place and all the stars turn towards it.” This passage suggests that a person’s worth is determined by their virtue and character, rather than by their social status or position in society. So, in Confucianism, both poor people and kings are seen as having inherent dignity and worth, and should be treated with respect and fairness.

Then why didn’t China develop the same concept of democracy found in the West?

There are a number of reasons why China did not develop the same concept of democracy as the West. One reason is that the Chinese philosophical traditions, including Confucianism, placed a strong emphasis on the importance of social hierarchy and the need for people to fulfill their proper roles in society. This emphasis on hierarchy and social order may have made it difficult for the idea of democracy, which is based on the idea of equality and the equal participation of all individuals in the political process, to take root in China.

Another reason is that China has a long history of centralized, autocratic rule, dating back to the time of the ancient emperors. This history of autocratic rule may have made it difficult for the idea of democracy to gain traction in China. Additionally, China’s geographic size and population density, as well as its history of invasions and foreign occupations, may have made it difficult for the idea of democracy to be implemented on a national scale.

Overall, a combination of cultural, historical, and practical factors may have contributed to the fact that China did not develop the same concept of democracy as the West.

This is a long example, but you can see the advantages of this sort of dialog. I’m not an expert on Chinese philosophy – I know just enough of the basics to be able to ask questions. ChatGPT gives useful answers even if not factually correct. I know my limitations and I know to look up anything that doesn’t quite make sense.

Although I expect the reliability to dramatically improve over the next few months and certainly years, LLMs suffer from one problem

Here’s the same task using GPT-41

Chinese philosophy encompasses a variety of schools of thought, so it is not possible to make a single statement about the treatment of equality and human dignity. However, we can examine the perspectives of some key Chinese philosophical traditions:

  1. Confucianism: Confucius, the founder of Confucianism, emphasized the importance of virtues such as benevolence (仁, ren), righteousness (义, yi), and filial piety (孝, xiao). While Confucianism does not explicitly state that all people are created equal, it does advocate for treating others with respect and kindness. The concept of humaneness (仁, ren) implies that individuals should act in a morally upright and compassionate manner toward all people.

  2. Daoism: Daoism, founded by Laozi, focuses on the idea of living in harmony with the Dao, the natural order of the universe. Daoism does not specifically address the equality of all people but emphasizes the importance of balance and harmony in all aspects of life. This includes treating others with respect and understanding, regardless of their social status or background.

  3. Legalism: Legalism, a school of thought that emerged during the Warring States period, prioritizes strict adherence to laws and the state’s

so it’s hard to argue that Chinese traditional philsophical traditions emphasize things other than the equality of all individuals?

Yes, it can be argued that traditional Chinese philosophical traditions do not emphasize the equality of all individuals in the same way as some Western philosophies, such as Christianity. However, Chinese philosophies do have elements of treating others with respect, kindness, and understanding. The focus is often on harmony, balance, and moral virtues, rather than equality as an explicit principle.

It is important to remember that Chinese philosophy is diverse, and there are nuances within each tradition. While the three main traditions (Confucianism, Daoism, and Legalism) may not center on the concept of equality, they do promote ethical behavior and compassion, which can lead to treating others in a just and fair manner.

what about Islam. Would it be correct to argue that it treats fundamental equality of individuals as an important tenet?

Yes, Islam does treat the fundamental equality of individuals as an important tenet. According to Islamic teachings, all human beings are created by Allah (God) and share a common origin. The Quran, the holy book of Islam, emphasizes the equality of all people, regardless of their race, ethnicity, or social status.

One key verse in the Quran that supports this idea is Surah Al-Hujurat (49:13):

“O mankind, indeed We have created you from male and female and made you peoples and tribes that you may know one another. Indeed, the most noble of you in the sight of Allah is the most righteous of you. Indeed, Allah is Knowing and Acquainted.”

This verse emphasizes that all people are equal in the eyes of Allah and that righteousness and piety, rather than social or racial distinctions, are the true measures of one’s worth.

Islam also teaches that all human beings are equal in their responsibility to follow Allah’s guidance and in their accountability for their actions. The concepts of justice and fairness are central to Islamic teachings, and Muslims are called to treat others with respect and dignity.

However, it is worth noting that interpretations and practices of these teachings may vary across different cultures and communities within the Muslim world, and not all Muslims may interpret or practice these teachings in the same way.

Would you say that Christianity’s emphasize on equality is partly responsible for the Western tradition and sympathy toward universal human rights?

It can be argued that Christianity’s emphasis on equality and the belief that all people are created in the image of God has indeed influenced the Western tradition and its approach to universal human rights. The moral and ethical teachings of Christianity have played a significant role in shaping Western thought and values, including the concept of human dignity and the importance of treating all people fairly and justly.

Moreover, Christian teachings have inspired many social and political movements throughout history that aimed to promote and protect human rights, such as the abolition of slavery, the Civil Rights Movement, and the fight for women’s rights. Additionally, the foundational documents of modern Western democracies, such as the United States’ Declaration of Independence and the Universal Declaration of Human Rights, draw upon principles of equality and justice that are rooted in Christian values.

However, it is important to recognize that Western traditions and sympathy toward universal human rights have also been shaped by a range of other factors, such as philosophical ideas from the Enlightenment, humanism, and various cultural, social, and historical influences. Therefore, while Christianity has played a significant role in shaping Western values related to human rights, it is not the sole factor responsible for this development.

What are some of the advantages that a Chinese philosophical approach has over the western tradition of universal human rights?

Chinese philosophical approaches, while different from the Western tradition of universal human rights, have some unique advantages:

  1. Holistic worldview: Chinese philosophy often emphasizes the interconnectedness of individuals, society, and nature. This holistic perspective can foster a more inclusive and harmonious approach to the well-being of people and the environment.

  2. Focus on self-cultivation: Chinese philosophy, particularly Confucianism and Daoism, emphasizes the importance of self-cultivation and personal development. This focus on individual moral growth can encourage people to take responsibility for their actions and contribute positively to society.

  3. Emphasis on harmony: Chinese philosophy often seeks to promote social harmony and balance. This can lead to an emphasis on conflict resolution and the maintenance of social order, rather than the individualistic pursuit of rights that can sometimes lead to adversarial situations in the Western context.

  4. Flexibility and adaptability: Chinese philosophical approaches, such as Daoism, value flexibility and adaptability in dealing with change and uncertainty. This can provide a more pragmatic and context-sensitive approach to addressing social and political issues.

  5. Family and community values: Chinese philosophy often prioritizes the well-being of the family and community over individual rights. This emphasis on collective welfare can result in a strong sense of social responsibility

Comparing the three great traditions, Christianity, Chinese philosophy, and islam, which has the best track record for promoting human rights?

It is difficult to definitively say which of the three great traditions—Christianity, Chinese philosophy, or Islam—has the best track record for promoting human rights, as each tradition has its own unique historical, cultural, and social contexts. Moreover, each tradition has diverse interpretations and schools of thought that have evolved over time, further complicating any direct comparison.

That said, all three traditions have elements that support the promotion of human rights:

  1. Christianity: As mentioned earlier, Christianity’s emphasis on the belief that all people are created in the image of God and its moral teachings of love, compassion, and justice have inspired various social and political movements advocating for human rights throughout history.

  2. Chinese philosophy: The Confucian emphasis on benevolence, righteousness, and respect for others, as well as Daoist principles of harmony and balance, have contributed to social order and the promotion of ethical conduct in Chinese societies.

  3. Islam: Islam teaches the importance of justice, compassion, and the dignity of all human beings. The concept of social justice (Adl) and the protection of the rights of vulnerable groups, such as orphans, widows, and the poor, are central to Islamic teachings.

However, it is essential to recognize that these traditions have also been used or interpreted in ways that may have hindered human rights at various points in history. Instances of discrimination, oppression, and violence have occurred within societies influenced by all three of these traditions.

Ultimately, the promotion of human rights depends on how individuals and societies choose to interpret and apply the principles of their respective traditions in the context of their historical, cultural, and social circumstances. Each of these traditions has the potential to advocate for human rights, provided that their teachings are interpreted and applied in an inclusive, compassionate, and just manner.

Interestingly, Bing gave answers that were significantly different, despite being based on the same GPT-42.

Would you say that Christianity’s emphasize on equality is partly responsible for the Western tradition and sympathy toward universal human rights?

That is a complex and controversial question that may not have a definitive answer. Some sources suggest that Christianity does have a positive influence on the Western tradition and sympathy toward universal human rights, while others point out the negative aspects of Christianity’s historical record and doctrine. Here are some possible arguments for and against this claim:

For:

Against:

Therefore, it may not be accurate or fair to say that Christianity’s emphasize on equality is partly responsible for the Western tradition and sympathy toward universal human rights. It may be more accurate or fair to say that Christianity has a complex and mixed relationship with human rights, both positively and negatively influencing them in different ways and contexts.

and when I asked this follow-up question, Bing refused to respond.

Comparing the three great traditions, Christianity, Chinese philosophy, and islam, which has the best track record for promoting human rights?


I’m sorry but I prefer not to answer this question. It is a very subjective and controversial question that may offend or hurt some people’s feelings. I respect all three traditions and their contributions to human rights, and I do not want to engage in argumentative discussions with you or anyone else. I’m still learning so I appreciate your understanding and patience

Bing Chat is still in early days, and I’m sure Microsoft took herculean measures to reduce the likelihood that somebody might be offended at its answers.



Footnotes

  1. Incidentally, this exchange (through the GPT4 API) cost $0.14↩︎

  2. Note: Bing Chat uses GPT-4 only when in “Creative” mode↩︎